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Abstract 

We consider the link average of the half-BPS Wilson loop operators in A/" = 6 super- 
conformal Chern-Simons-matter theory, which is called ABJM theory. We show that 
this loop average is reduced to a (super)niatrix integral by the localization method, in 
a similar way to the bosonic U(7V) Chern-Simons theory. Using this matrix integral, 
we compute the two- and three-link averages with an operator formalism inspired by a 
three-dimensional topological field theory. We obtain a factorization of the link average, 
and the Verlinde formula in a sector of supergroup representations. We also propose a 
refined version of ABJM theory, and compute some refined link averages. 
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1 Introduction 

The Wilson loop operator plays an important role in Chern-Simons theory, which is a three- 
dimensional topological field theory. This is because its expectation value is a topological 
invariant, which encodes the shape of a knot along which the loop operator is defined [T]. 
In addition to a single knot invariant, the average of linked loops also has a meaning in 
its relation to the two-dimensional conformal field theory (CFT). For example, the matrix 
element of the modular S'-matrix is given by the two-link average, which is called the Hopf 
link invariant. Furthermore, the three-link average also has an interpretation as the fusion 
coefficient in the corresponding two-dimensional CFT. In this way, link averages play a 
key role in the connection between the three-dimensional topological theory and the two- 
dimensional CFT. 

Recently a new class of Chern-Simons theories has been proposed based on motiva¬ 
tions from string and M-theory. The most important example is AA = 6 superconformal 
Chern-Simons-matter theory, which is called ABJM theory mm- Although the direct 
computation of the path integral is a difficult problem in general, we can reduce such an 
infinite-dimensional integral to a matrix integral in a class of supersymmetric field theories. 
This procedure is called the localization method [1], and shows that \J{N)k x U(M)_fc ABJM 
theory reduces to \J{N\M) Chern-Simons theory [5l|6l[7]. In this supergroup \J{N\M), the 
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bosonic part encodes the gauge symmetry, and the fermionic part characterizes the matter 
content of the theory [8|. By applying various methods developed in matrix models, one can 
compute Wilson loop averages in addition to the partition function itself, in agreement with 
the result from the AdS/CFT correspondence. 

In this paper we consider link averages of the half-BPS Wilson loop operator in ABJM 
theory, based on the finite-dimensional matrix integral expression, obtained via the local¬ 
ization method. We will show that some important properties of the U(A^) Chern-Simons 
theory is generalized to the \J{N\M) theory, at least in specific situations. 

The bosonic Chern-Simons theory has an interesting generalization called the refined 
Chern-Simons theory [9]. In this case, the Wilson loop expectation values provide refined 
knot invariants, which are given by the Poincare polynomial of the corresponding knot ho¬ 
mology. The rehned theory has no Lagrangian description, but only a construction based 
on topological string theory. Following the same argument in the U(A^|M) theory, we will 
consider the refinement of ABJM theory, and compute several link averages of the Wilson 
loop operator in the refined theory. In this case, these loop operators are described by the 
U(A^|M) Macdonald polynomial. 


2 Localizing linking loops 


Computing the partition function and observable is highly non-trivial in general, because one 
has to deal with infinite-dimensional path integral in quantum field theory. On the other 
hand, in a class of quantum field theories involving supersymmetry, this infinite-dimensional 
integral can be reduced to a matrix integral, by applying the so-called localization method. 

It was shown by [S] that, m Af = 2 supersymmetric Chern-Simons theory on three- 
sphere the supersymmetrized Wilson loop operator [TO] along a great circle preserves 
a supersymmetry, which is necessary for localizing the path integral. Thus its expectation 
value can be written in a form of matrix integral. For example, for M = 2 Chern-Simons 
theory with gauge group G = \J{N), involving no matter fields, one can compute the Wilson 
loop average 
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where U{x) = diag(e^i,..., e*^) is a holonomy matrix. Since it is an element of U(A^), 
these variables should be seen as pure imaginary, Xi G iM. Even with this parametrization, 
this integral is still converging, because, as specified later, the coupling constant Qs is also 
pure imaginary. Therefore it makes sense as the Fresnel integral. Then the corresponding 
partition function is given by 
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This result is consistent with the bosonic Chern-Simons theory m, because, in this case 
without matter contributions, we can integrate out the auxiliary fields in a trivial way. 

As pointed out in [5], the choice of great circle is not unique. There is a family of circles on 
which the Wilson loops preserve the same supersymmetry used to localize the path integral. 
These circles are generated by a vector field built with the Killing spinor and form 

a Hopf fibration. Therefore one can similarly compute an average of linking loops in this 
fibration by the localization using the same supersymmetry, 

(iViJi • • • = ( Tr«, U{x) • • • Tr«, . (2.3) 

This is also consistent with the link average in the bosonic Chern-Simons theory. We remark 
that a multi-loop average in a four-sphere can be obtained in a similar way, as multiple 
insertion of holonomy matrices into the matrix integral |Tj. However these loops are not 
linked anymore in four-dimensional space. 

In order to consider the maximally supersymmetric Wilson loop in ABJM theory, namely 
the half-BPS Wilson loop operator in AA = 6 theory, one has to assign a U(A^|M) supercon¬ 
nection, instead of the bosonic U(A^) connection, which just provides the 1/6 BPS Wilson 
loop [6]. An important observation here is that these two kinds of loops belong to the same 
cohomology class under the supercharge used in the computation for Af = 2 theory. Thus the 
difference between them is exact with respect to a linear combination of the supercharges. 
This implies that the same localization method can be applied to the half-BPS linking loops 
forming the Hopf fibration. 


(Wr^-'-Wr^'^^^ = (^StrR^ U{x-,y)---StrR^ U{x;y)'j^ 


, (2-4) 
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where the corresponding partition function is the so-called ABJ(M) matrix model, which is 
seen as a supermatrix version of the Chern-Simons matrix model. 
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and the super symmetrized holonomy matrix is given by 
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U{x\y) = 
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The trace of this matrix yields a character of U(A^|M) group in representation R, which is 
expressed by the Schur polynomial with a prescribed symmetry m, 


StrRU{x;y) = SA(R)(e"';e^), 


(2.7) 
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where A(i?) is the highest weight vector corresponding to the representation R. This char¬ 
acter is obtained from the Schur polynomial for U(A^ -|- M) group in the following way: 
The Schur polynomial can be expressed as a linear combination of power-sum polynomi¬ 
als Pf_t{x,y) = Y\j corresponding to a trace in the fundamental representation 

Pn{x,y) = TrC/(x,y)"', which is known as the Frobenius formula, 



( 2 . 8 ) 


where xa and are the character and the conjugacy class for the symmetric group &N+M, 
and the coefficient is given by pj ! . Replacing the ordinary trace with the 

supertrace pn{x,y) —)• pn{x\y) = Str:U{x]y)^ in this expression, one obtains (12.7p . See Ap¬ 
pendix!^ for various properties of this Schur polynomial, which will be used in the following 
Sections. 

3 Operator formalism 

As shown in Section [2l the link average in ABJM theory can be discussed in a similar way to 
the bosonic Chern-Simons theory, which is a topological field theory in three dimensions. In 
general, the path integral of topological field theory on a three-manifold M can be described 
using a state in the Hilbert space T-Ly. associated with the boundary dM = S, which is 
obtained through canonical quantization on S x R. Once a state in this Hilbert space is 
given, |M) G Ry, its dual is obtained by inverting the orientation of the boundary, (M| G 
Then the inner product of these states gives the partition function of the three-dimensional 
theory on M. In this sense it is convenient to consider the operator formalism based on this 
boundary theory in order to compute observables in topological field theory on the three- 
manifold M. We will formally apply this construction to ABJM theory, which is motivated 
by the bosonic Chern-Simons theory. 

Loop insertion and modnlar transformation 

Let us first review the operator formalism in the bosonic Chern-Simons theory [Tj. For our 
purpose, we choose the boundary as a two-dimensional torus S = T^, and take a solid torus 
to obtain the Hilbert space R'y 2 . We consider a state given by inserting a Wilson line in 
representation Ri along the non-contractible cycle of the solid torus. 


Ri) = £ Rt^ , 


(3.1) 


where the operator Or. is a creation operator of the Wilson loop in representation Ri. Then 


taking an inner product between this and its dual, we obtain the partition function with two 
Wilson lines in 3“^ x S^, 


{Ri\Rj) = Z{S^ X S^-,Ri,Rj). 


(3.2) 
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This defines a Hermitian metric 


9ij ~ (3-3) 

on the Hilbert space, because its conjugation is simply given by g^. = gj^. 

In addition to the creation operator Oji of the Wilson line, we have another set of 
operators, corresponding to the mapping class group of the torus, which is given by SL(2, Z) 
group. Let us introduce S and T matrices, describing the modular transformation of the 
torus, with the SL(2,Z) relation, 

S^ = l, {STf = . (3.4) 

These allow us to compute the path integral on a three-sphere . This is because the three- 
sphere is obtained from S'^ x by applying the modular transformation S, which converts 
the modulus of the torus, r ^ ~l/'r. Prom this point of view, the matrix element of the 
S-matrix computes the linking knots, namely the Hopf link average in the three-sphere S^, 

S- = = Z{S^;R^,Rj), (3.5) 

and, by normalizing it with the partition function, we obtain the Hopf link invariant 

_Z{S^-Ri,R,) 

Sm z{s^) ■ ^ ^ ^ 

We will compute this average in Section [3.11 We remark that, to obtain the three-sphere 
we can apply more general choice of the transformation, with arbitrary integers n 

and m. This T-transformation gives rise to a framing factor in the knot average. 


Wavefunction 


Based on the formalism discussed above, let us then consider a wavefunction corresponding 
to a state in the Hilbert space, which allows us to compute the path integral more explicitly. 

For the U(Ai) Chern-Simons theory, the wavefunction for the situation without any 
Wilson lines, corresponding to the vacuum state, is given by the partition function of Chern- 
Simons theory on a solid torus m- Let us denote it by 


(x|0) 
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The factor is determined to be consistent with normalization of the metric. Because the 
expression on the right-hand side can be written as the Vandermonde determinant, up to 
some trivial factors, this wavefunction is seen as the Slater determinant of the V-particle 
system. 
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If we insert the Wilson line in representation R into the solid torus, the corresponding 
wavefunction is given by 

1 ^ / - A 

^ ■ i<j ^ ^ 

The Schur polynomial sji{e^) added here shows the trace of the holonomy matrix in repre¬ 
sentation R, 


Tt:rU{x) = Si?(e"'). 


(3.9) 


Now the highest weight vector for the representation R is also denoted by R, as far as there 
is no confusion. As pointed out in Section [21 these variables shall behave as pure imaginary 
Xi G iM. Thus the conjugate of this wavefunction is given by 

{R\x) = 1 ^sinh 

^ ■ i<j ^ 

Then we compute the inner product of these states, 

■ i=i i<j ^ ^ 

Applying the determinantal formula for the Schur polynomial 

1 _• ^ 


>r(o-‘) . (3.10) 


the inner product is given by 


which yields 


(RARj) = det 

l<k,l<N 


2n J 


(3.13) 


ff-ij = ■ (3.14) 

Here Rj^k stands for the A:-th component of the highest weight vector corresponding to the 
representation Rj. This is just the orthonormal property of the Schur polynomial with 
respect to the weight function A(e*)^ |14] . 


U(A^|M) theory 

Let us then discuss the U(A^|M) Chern-Simons theory in a similar way. Actually, in the 
sense of ABJM theory, the meaning of the operator formalism is not yet clear, because this 
ABJM theory is not just a topological theory. However, there are several results encouraging 
us to apply it to ABJM theory. For example, the ABJM matrix model is equivalent to 
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Chern-Simons theory on the lens space S'^/Z 2 through the analytic continuation [7], and 
at least for the latter theory, we can apply the same operator formalism because the lens 
space Chern-Simons theory is a topological theory defined on a Seifert-type three-manifold. 
Another remark is that the ABJM model can be seen as a many-body system of fermionic 
particles m- From this point of view, it is natural to consider the wavefunction of ABJM 
theory in a similar way to the bosonic U(A^) theory shown above. 

Now, by analogy with the U(A^) Chern-Simons theory, we introduce a wavefunction for 
the U(A'|M) theory, corresponding to the vacuum state 
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As well as the bosonic Chern-Simons theory, this wavefunction can be interpreted as the 
Slater determinant based on the formula, 

n (2.mh^i:^) n (2-nh^) nn 
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where we assume N > M. Similarly a wavefunction for a state with the Wilson line in 
representation R is given by 
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Although it is difficult to compute the inner product for generic representations, an interest¬ 
ing simplification occurs in a special case: If the highest weight vector A satisfies Aat > M, 
the U(A^|M) Schur polynomial is factorized into the U(A^) and U(M) Schur polynomials. 
We call such a representation a maximal representation in this paper^ We focus on this 
situation in the following. 

^ The U(N|M) Schur polynomial becomes identically zero in the case with \n+i > M + 1. In this sense, 
the representation with Ajv > M is interpreted as maximal, and this is the reason why we call the situation 
with Ajv > M a maximal representation. See Appendix El and also [HUS]. 
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Let us compute the inner product of the states defined above. When both of the repre¬ 
sentations belong to the maximal class, we can apply the formula (IA.6I1 . In such a case it is 
given by 


{RARn) = det 

l<k,l<N 


det 

27r J l<k,l<M 


27r J 


rA'>^r\^'>R^^'> ’ (3.19) 

where the representations and are obtained from the original one so that R^^^ = 
Ri^k — M for k = 1,... ,N and = Rj ^ — N for k = 1,..., M. See Figure [3l This shows 
the orthogonality relation for U(A^|M) Schur polynomial with respect to the corresponding 
weight function, and thus the metric (|3.3D is given by 


9lj 



(3.20) 


We have derived this result only for the maximal representation. However it is not obvious 
whether this orthogonality holds for generic representations. We will give a relating comment 
in Section [S] in the relation to the two-dimensional CFT with internal supersymmetry. 


3.1 Two-point function: Hopf link 

As mentioned before, the 5-matrix plays a key role in computing the path integral for the 
three-sphere 5^. Actually its matrix element provides the Hopf link invariant in 5^, and 
also involves the unknot invariant as a special case. In this Section we consider the 5-matrix 
element in an explicit way, and then compute the Hopf link average as the two-point function 
in the ABJM matrix model. 


U(A^) theory 


For the U(A^) theory, the wavefunction corresponding to the state obtained by the modular 
transformation TST is given by m 
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where gs is the coupling constant defined with the level and the rank of Chern-Simons theory, 
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As a result, we can compute the matrix element of TST as a two-point function of the Schur 
polynomial in the Chern-Simons matrix model. 
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This is consistent with the expression (j2.3p . up to the orientation of the loop, because the 
operator in the representation Ri is now in the opposite direction. This two-point function 
can be easily computed using the explicit formula of the Schur polynomial ()3.12p . 
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We have defined the parameter qhy q = e~^‘‘. If we modify the variables Xi ixi , it should 
be replaced with g —>• e^'*. 

Rewriting the expression in terms of the Schur polynomial again, it yields 

{TST)j^ = CN SR,{q^^+P) SR^iqP) , (3.25) 

where the constant cn is given by cn = p is the Weyl vector, 

Pi = —i + 1/2, and 6 * 2 ( 1 ?) is the second Casimir operator, 

0') • P.26) 

Actually the factor of this Casimir operator is interpreted as the framing factor, which is 
given by the conformal weight of the primary field, and this contribution just stands for the 
action of the modular T-matrix, 
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Thus we obtain the Hopf link invariant by the normalized 5-matrix, 

^ = SRM'^^+nsR,{qn- (3.28) 
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Although this expression is not symmetric superficially, we can show that it is symmetric 
under the exchange i j- 


U(A^|M) theory 


Let us then apply the same approach to the U(A^|M) theory. In this case, although there is 
no rigorous foundation of this argument, we propose the following form of the wavefunction 
based on consistency and analogy with the U(A^) theory, 
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Actually this expression is obtained from the Chern-Simons theory on the lens space 5^/22 
through the analytic continuation. Now the coupling constant depends only on the level of 
\J{N)k X U(M)_fc ABJ(M) theory, 



(3.30) 


Using this expression, we obtain the corresponding matrix element, which is consistent with 
the Hopf link average (j2.4p in this theory 
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We remark that the orientation of the loop operator in the representation Ri is flipped again. 
Let us denote this matrix element by to distinguish it from that in the bosonic 

U(N) theory. We can immediately check that this reproduces the U(A^|M) matrix model 
partition function (12.5p by taking the trivial representation. 
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In general, it is difficult to compute this matrix element for arbitrary representation. 
However, a similar simplification occurs if we take the maximal representation, as in the case 
of the inner product discussed before. When one of the representations is trivial, and the 
other is maximal, it gives the U(N|M) unknot average [17| . 

- N-m n M 


{TST)or = JV+M Q 
k 2 


_i(Ar_M)3 + ^(iV-M) 






N M 

nn 


g, _p qnj 


-1 


i=l 

N 

n 




Q 


i=i 


M 

n 


_ qV, 


(3.33) 


i=l j=l 


i<j 


i<j 


where we have defined 


^i = Ri - i+ ^ = Ri + Pi for i = l,...,N, (3.34) 

Vj = R] - j+ ^ = Rj + Pj for j = l,...,M, (3.35) 

with R = {Ri, ..., i? 7 v) and R = {R\, ..., R\j) as shown in Figure [H This average can be 
also written as a determinant, and reproduces the TJ{N) unknot average by taking M = 0. 
For the latter convenience, let us assume N = M and rewrite this expression in terms of the 
Schur polynomial, 

N M _ 

{TST)or = ^q--2^^(^'>+"2C2{R)A^^qP^AM{q-n s^(g") ^^(g-O H II ' 

i=lj=l 

(3.36) 
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Figure 1: The partition A = (14,11,11,9, 8,6, 5, 5, 4, 3, 2, 2) satisfying the maximal condition 
\n > M ioT N = 7 and M = 5, which includes A = (14,11,11,9,8,6,5) (blue) and A = 
(12,12,10,9,8) (red). See also Figure [3l 


When the both of representations are maximal, we can again apply the formula (IA.6I) to 
compute the matrix element (I3.3ip . In this case we obtain an expression which is completely 
factorized into U(A^) and U(M) sectors. 
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1 2 
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It is also expressed in terms of Schur polynomials, 
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with the constant factor 
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(3.37) 


(3.38) 


(3.39) 


From the expressions of (|3.36l) and (I3.38p . it is natural to read off the matrix element of the 
T-matrix for the maximal representation, which gives the framing factor in the loop average. 


^U(JV|M)(^) ^ ic2(4)+|C2(i?d 


(3.40) 


Thus we obtain the factorized S-matrix element. 


^U(iV|M)(^) ^ ^ . (3.41) 

ij ij 

This interesting property can be shown only for the maximal case at this moment. It is 
expected that such a factorization is not found explicitly for the non-maximal situation, 
because it is difficult to split the U(A^|M) representation into U(A^) and U(M) sectors in 
general, and probably related to the chiral non-factorizability of the two-dimensional CFT 
with internal supersymmetry. See also discussion in Section [5l 
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3.2 Three-point function: Verlinde formula 

In addition to the two-point function, which gives the Hopf link average, the three-point 
function also plays an important role in the two-dimensional CFT, and the three-dimensional 
topological field theory. In CFT, the product of operators can be expanded by a set of 
operators in general, 

(3.42) 

k 

and thus the fusion coefficient N- ^ in this expansion plays a role of the structure con¬ 
stant. The statement of Verlinde’s conjecture is that the 5-matrix diagonalizes this fusion 
coefficient, which is equivalent to the relation for the 5-matirx |18j . 

(3-43) 

Actually this coefficient is simply understood in terms of the operator formalism, 

= (0|i2j Rj Rk ), (3.44) 

which corresponds to the three-point function in Chern-Simons theory. This is very general 
result for CFT, and topological field theory associated with this fusion rule. 

In particular, for the U(A^) Chern-Simons theory, the fusion coefficient (|3.42l) coincides 
with the Littlewood-Richardson coefficient, which appears in the product of Schur polyno¬ 
mials, 

SRi (x) SR. (x) = Nij ^ SR^ (x). (3.45) 

k 

Now the degree of representation is conserved on the both-hand sides, |Rj| -|- |i?jj = 

This follows the fact that the action of the operator Or. is just given by multiplication 
of the Schur polynomial in representation Ri. From this point of view, we can show the 
Verlinde formula ()3.43p using the explicit form of the 5-matrix element ()3.28p . Multiplying 
the equation (13.431) by (5 ^q)“^, the left-hand side is given by 

(9®*+'’) (9®*+') = E %' • (3'«) 

Ho Ho £ 

which coincides with the right-hand side of the formula (j3.43p . 

Let us then apply this argument to the U(A^|M) theory. Again we consider the maximal 
representations. In this case it can be shown that the product of U(iV|M) Schur polynomials 
is expanded only with the maximal U(A^|M) Schur polynomials again. Applying the formula 

N M 

E '5A(a;)'Sv(y) (3-47) 

i=lj=l XcM^ 
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where A C implies Ai < M and A^ < iV with = {N — X\,j,... ,N — A^) [H], the 
product is given by 


N M 


SRiix-,y)sR.{x-y) = N-(i)jfi) (a^) (y) JJ JJ (a:* + yj) 

i,m,n i=l j=l 


'^^ij^SR^ix^y). 


(3.48) 


where the fusion coefficient is defined 




i(i)ji(i) i(^) j(^) 


AT AT rX'^'> 


£,m 


(3.49) 


Again we have a conservation law of the degree of representations, |i2j| + \Rj\ = \Rk\- We 
remark that, since the representation is now restricted to the maximal ones, the summation 
over the representation means = X]n(i) n(2) so on. The fusion coefficient (I3.48p is the 
U(Ai|M) version of the Littlewood-Richardson coefficient, and this shows that the maximal 
representations form a closed subsector in the whole space of U(A^|M) representations. 

Once the fusion coefficient is given in the U(A^|M) theory, we can similarly discuss the 
Verlinde formula for the modular 5-matrix (I3.43|) . Assuming N = M for simplicity, the ratio 
of the 5-matrix is obtained from the expressions (|3.36p and (|3.38p . 


^ki 

^kO 


N 

/,m=l 


(3.50) 


Again this ratio is written in terms of the Schur polynomial itself, as well as the bosonic 
U(A^) theory. Thus, applying the fusion formula p.48l) . we obtain 

SR ,, (3.51) 

^ko ^ko e 

which shows the Verlinde formula for the U(Ai|M) theory. This result suggests that we can 
construct a topological (knot) invariant from the U(V|M) theory in a quite similar way to 
the bosonic U(V) theory, at least for the maximal representations. 


4 Refinement of \J{N\M) theory 

The result shown in Section [3] suggests that the U(V|M) theory follows most of the properties 
of the bosonic V{N) Chern-Simons theory. In this Section, based on such a similarity, we try 
to apply another interesting generalization of Chern-Simons theory to the U(Ai|M) theory. 
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Figure 2: Chern-Simons theory to the refined supermatrix Chern-Simons (ABJM) theory. 
We apply the same way to obtain ABJM theory from Chern-Simons theory to the refined 
theory. 


4.1 Refined partition function 


Based on the construction of Chern-Simons theory using topological strings and its inter¬ 
pretation in M-theory, it has been proposed that the refined index of M-theory defines the 
refined Chern-Simons theory [2j. The most important example is the refined theory on the 
three-sphere S^. However its construction can be applied to a wide range of three manifolds, 
by replacing the Calabi-Yau threefold and the corresponding Lagrangian submanifold for 
M5-branes. Indeed the ABJM theory is obtained from the Chern-Simons theory on the lens 
space 8^11^2 through the analytic continuation. In this sense, we can discuss the refined 
ABJM theory similarly using the refined U(A^|M) theory defined on 17^2 (see Figure m- 
As well as the bosonic U(AI) Chern-Simons theory, the partition function of the U(A^) 
refined Chern-Simons theory on has a (matrix) integral form. 


*7 Ref 
^U(A^) 




N 




dxi _ 1 


N 


i=l 


2tt 


Q 25s 


/3-1 

nn 

i<j m=0 


Tijl2^ml2 _ ^-Xij 


/2^-m/2 


(4.1) 


where we write xtj = Xi — xj, and the coupling constant is slightly modified q = e~^‘‘ with 
Qs = ‘2 'k\I( k + I3N). The remarkable modification is the measure part of this matrix integral, 
which depends on the additional parameter [3. This expression corresponds to the situation 
such that t = q^ with /3 G N, and we focus basically on this case in the following for simplicity. 
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For generic /3, it is represented using infinite product, 

N OO 

nn 


^Xijf2qml2 _ ^-Xijl2g-ml2 

■- -A--A- QX-ij j2-^\j2Q7nj2 _g X{j j2-^ —1/2^— Tn,j2 

i<j m=0 ^ ^ 


N /3-1 

II ^ ^ ^/3 ^ N) 

i<j m=0 


(4.2) 


It is easy to see that this is reduced to the non-refined Chern-Simons partition function (|2.2p 
by taking /3 = 1, namely t = q. As seen later, this modification corresponds to that for the 
Macdonald polynomial from the Schur polynomial. 

This refined Chern-Simons theory has essentially the same SL(2,Z) structure in its oper¬ 
ator formalism as the non-refined Chern-Simons theory [9]. This means that we can obtain 
the refined Chern-Simons theory on the lens space S'^/Z 2 applying the same SL(2, Z) action 
to the solid torus |13| . which partly breaks the gauge symmetry. Assuming that the system 
has the symmetry U(A^ -|- M) in the first place, which shall be broken into U(iV) x U(M), 
the partition function becomes 


' 2 ^uf^)xu(M)('S'^/^ 2 ; q,t) 


1 


N 


M 




/3=1 N M 


N\M\ 


2-k 

i=l 

0-1 N 

xnn 

m=0 i<j 


J=1 


m=0 i=l j=l 

o M 


^Xijl2 ml2 _ -Xij 72 -m/2 


n 

Kj 


3yo/2g"*/2 _ g-yo/2g-m/2 


(4.3) 


This is equivalent to the situation snch that the second set of variables is shifted due to the 
Z 2 discrete flat connection, yj —>■ yj + vri. Then, analytically continuating the gauge group 
rank M —>■ —M, which is approved at least in a perturbative sense (see, for example, m). 
and rescaling the coupling constant gs = 2711 !k, we obtain the refined ABJM matrix model, 


^ N 


1 


N\M\ 


A M 0=1 N M 

^n—n nn 


i=l 


J=1 


0-1 N 


m=0 i=l j=l 

r. M 


m=0 i<j 


n 

Kj 




■ (4.4) 


For the simplest case N = M = 1, we can exactly compute the partition function and several 
expectation values with this model. See Appendix [B] for details. This is one-parameter 
generalization of the ABJM matrix model (12.511 . and it is again rednced to the non-refined 
theory by taking /3 = 1. We remark that the matrix measure of this partition function is not 
written as a determinant anymore, due to the modification with the additional parameter t, 
while the non-refined measure has the Cauchy determinant expression. This implies that the 
corresponding wavefunction for the refined theory does not describe the free fermion system 
whose wavefunction has to be expressed as a Slater determinant. 
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4.2 Loop average 

For the refined U(A^|M) theory (14.41) . the most natural observable is the Wilson loop operator 
as well as the non-refined Chern-Simons theory. However, in this case, the insertion of the 
loop gives rise to the modified character of the corresponding group, which is expressed in 
terms of the Macdonald polynomial [S]. Therefore, first of all, we have to introduce the 
\J{N\M) version of the Macdonald polynomial for our purpose. 

The definition of the U(iV|M) Macdonald polynomial should be given in a similar way to 
the Schur polynomial, because it has to be reduced to the Schur polynomial in the limit t = q. 
The Macdonald polynomial is also a symmetric polynomial, which can be expanded with 
the power-sum polynomials. Thus, starting with the bosonic U(iV + M) Macdonald polyno¬ 
mial, and rewriting it in terms of the power-sum Ti U(x,y)^, one can obtain the U(A^|M) 
polynomial by replacing that power-sum with the U(A^|M) counterpart, Sir U{x;y)^. 

Even with this definition, it is still difficult to write down the explicit form of the poly¬ 
nomial for generic representations. However, especially for the maximal representation, it 
is natural for the U(A^|M) Macdonald polynomial to have a similar factorization formula 
as well as the Schur polynomial ()A.6p . It is because all the symmetric polynomials in the 
maximal representation have to span the vector space, corresponding to the subsector of the 
original U(A^|M) representations, given by U(A^) x U(M) C \J{N\M). This implies that 
it should be written as a product of the U(iV) and U(M) polynomials. This speculation 
leads to the conjectural expression for the U(A^|M) Macdonald polynomial in the maximal 
representation, which is a simple generalization of the factorization formula ()A.6p : 

N M 0-1 

Mxix; y) = {x)M^( 2 ) (y) H 11 11 • (4-5) 

i=l j=l m=0 

This is again the situation such that t = with /? G N, and its extension to arbitrary f3 is 
straightforward. 

Starting with the conjectural formula (14.5p . we can compute several expectation values 
in the refined U(A^|M) theory. Let us assume N = M m the following for simplicity. The 
first example is the refined version of the inner product (I3.19p . which gives the Hermitian 
metric of the corresponding Hilbert space (13.311 . 

. „ AT , , /3-1 V 

{Ri\Rj) = — Yl n n 

i=l m=0 i<j 

0-1 N _2 

^ n n (4.6) 

m=0 i,j=l 

For the maximal representation, we can apply the factorization formula ()4.5p . and thus this 
integral is factorized into two U(A^) sectors. Thus we can show the orthogonality 

dij = QiW diCi) <5^(i)^(2)(5^p)^(2) , (4.7) 
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where the normalization factor becomes m 


9i = 


rn=0 i<j *2 ^ 




(4.8) 


It implies that, in contrast to the non-refined theory, it is not orthonormal, but just or¬ 
thogonal, as well as the refined U(AI) theory, and it is easy to see that it again becomes 
orthonormal gi = 1 for /3 = 1. 

We can similarly compute the two-point function especially with the maximal represen¬ 
tation, which gives the modular S'-matrix element, 

1 r ^ j j /3-1 Af 

^TST)-j = ^ n n + / 2 ) 

i=l m=0i,j=l 

0-1 N 2 2 

X n n ^ 

m=0 i<j 

(4.9) 


In this case, due to the factorization of the Macdonald polynomial, we can similarly apply 
the result for the bosonic refined U(AI) theory [20], which yields 

0-1 N 

X n n . (4.10) 

m=0 i<j 

As well as the non-refined U(A^|M) theory (I3.38p . this matrix element is completely factorized 
into the two U(A') sectors. 


gViN\N) 


{q,t) 


ij ij 


{q \t y 


(4.11) 


The expressions shown above can be obtained by a simple replacement of the q parameter 
with {q,t) in a proper way. Furthermore, it is natural to expect that this refined U(iV|M) 
theory also involves the Verlinde formula at least for the maximal representations. Thus this 
speculation leads to the following expression of the S'-matrix ratio in terms of the U(A^|M) 
Macdonald polynomial, 


Si. 




^kO 


which immediately yields the Verlinde formula 
S-M S-kj 


Suo 


fcO /tO 


'S'fco 


(4.12) 


(4.13) 


where is the fusion coefficient for the U(V|M) Macdonald polynomial. In this case, 
this coefficient is not integer, but a rational function of q and t. From this point of view, 
the refined U(iV|M) theory also provides a topological (knot) invariant in a three-manifold, 
which is the categorified version of the non-refined U(A^|M) invariant, given by the Poincare 
polynomial of the knot homology. 
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4.3 Torus knot matrix model 


In addition to the partition function given in ()4.4I1 . we can obtain another kind of integral 
by applying the SL(2,Z) transformation, 


jj-Ref, (P^Q)fq3 


1 


N\Ml 


. N , M , 


1 ,,2 


/3=1 N M 


i=l 


J=1 


27r 


n JJ JJ 

m=0 i=l j=l 


-2 


0-1 N 

n n q-T 

m=0 i<j 


, M 


i<j 


(4.14) 


where the coupling constant is rescaled, q = e”^'* with gg = PQQs- Now one can compute the 
(P, Q) torus knot average of the Wilson loop operator with this integral, while the ordinary 
partition function corresponding to (P, Q) = (1,1) yields only the unknot average of the loop 
operator. The analysis of this integral would be interesting (and also complicated). However 
we only show some results especially for U(l|l) theory in Appendix iBl 


5 Discussion 

In this paper we have studied the link average of the half-BPS Wilson loop operator in ABJM 
theory based on the localization method. The resultant expression is a simple generalization 
to the supermatrix integral of the bosonic U(AI) Chern-Simons theory. We have computed 
the two- and three-link averages in the maximal representation using the operator formalism 
inspired by the three-dimensional topological field theory. For the two-link average, which 
plays a role of the modular S'-matrix, we have obtained the factorization formula correspond¬ 
ing to decomposition of the original supergroup into its subsectors, U(A') xU(M) C U(N|M). 
For the three-link average, we have shown the Verlinde formula in the U(N|M) theory. We 
have also discussed a refinement of ABJM theory by applying the argument based on topolog¬ 
ical string theory. Applying the conjectural formula for the U(Ai|M) Macdonald polynomial, 
we have derived the refined version of the link averages in several cases. 

The operator formalism for the \J{N\M) theory, as discussed in this paper, has an analo¬ 
gous structure with the bosonic U(N) theory for a class of the representation, which we call 
the maximal representations. This implies that we would have the chiral factorization on 
the boundary of the three-manifold. From the conformal field theoretical point of view, it is 
slightly an amazing property, because such a factorization does not occur in a wide range of 
CFTs involving internal supersymmetry. See, for example, a review article m on this topic. 
Therefore, in this sense, it would be interesting to see what happens in CFTs with inter¬ 
nal supersymmetry with a sufficiently large representation, e.g., the maximal representation 
discussed in this paper. 
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The result obtained in this paper also suggests that we can similarly construct the knot 
invariant associated with the supergroup U(A^|M) even without using the matrix integral 
formula, namely just based on the Skein relation. At this moment it is not yet obvious 
whether it is possible for generic representation. However, for the maximal representation, 
we have almost the same property of the link averages as the bosonic U(A^) theory, and thus 
it suggests a possibility to build a topological invariant with the U(A^|M) theory. Even in 
this case it is non-trivial, because originally ABJM theory is just conformal, but not yet topo¬ 
logical. If we can successfully construct such an invariant, it would be interesting to study 
the volume conjecture for hyperbolic knots, since we can discuss the large representation 
limit with the maximal representation. 

For the refined \J{N\M) theory, there are a lot of works to be investigated. First of all, it 
must be important to prove the conjectural factorization formula for the U(A"|M) Macdonald 
polynomial in the maximal representation. Since there is no determinant structure in this 
case, its proof would be more difficult than the Schur polynomial, and thus we should apply 
another approach, for example, based on the differential (difference) operator acting on the 
symmetric polynomial. A related issue is to explore an integrable model which is associated 
with the U(A^|M) Macdonald polynomial, namely the supergroup version of the Ruijsenaars- 
Schneider model, and also its elliptic analog. In addition, it might be possible to construct 
W-algebra based on this kind of supergroup. 
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A \J{N\M) Schur polynomial 


Let us summarize several properties of the \J{N\M) Schur polynomial, which are use¬ 
ful for the computation in the main part. For U(A|A) theory, there is a determinantal 
formula, which is expressed in terms of the Frobenius coordinate of the partition A = 

(«!,...,arf(A)|/3i,...,/3rf(A)) US], 


sx(u; v) = det 

l<i,j<d{\) 



with 


C^J = 


1 


Ui + V 


(A.l) 




Here the matrix C is called the Cauchy matrix, and C~^ in the formula is its inverse. d{X) 
is the diagonal length of the partition A, and the Frobenius coordinates are associated with 
the partition in a relation of «* = A* — i and /?, = A* — i. This formula means that this Schur 
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Figure 3: The partition A = (14,11,11,9, 8,6,5,5,4, 3, 2, 2) satisfying the maximal condition 
Xn > M foT N = 7 and M = 5, which includes /r = (9,6, 6,4, 3,1,0) and = (5,4, 3, 2, 2). 

polynomial is written as a determinant of those in the hook representation 

sxiu] v) = ’ (^-2) 

which is the Giambelli formula in this case. From this formula, it is easily shown that 
sx{u;v) = 0 if d{X) > N, and let us call the representation corresponding to the situation 
with d{X) = N, which is equivalent to Xn > N, a maximal representation in this article. 

An important consequence of the determinantal formula (jA.lh is that, in the maximal 
situation d{X) = N, it is factorized into the U(Ai) and U(M) Schur polynomials, 

N 

Sxiu] v) = s^{u)s^{v) {Ui + Vj ), (A.3) 

where the partitions in this formula are obtained from the original one, 

Pi = Xi-N, u, = X\-N for i = l,...,iV, (A.4) 

or equivalently, 

lA = X\j^N ) = Xij^N ■ (A.5) 

This kind of factorization can be also found in U(A^|M) theory. In this case, we call the 
situation with Aat > M a maximal representation, and we have 

N M 

sx{u-,v) = s^{u)s^{v) n + Vj). (A.6) 

i=lj=l 

Here the partitions are given by fii = Xi—M for i = 1,..., A/ and vi = X\—N for i = 1,..., M, 
or = A*_|_^ and r'j = Aj+at. We show an example of the maximal situation in Figure El 
This factorization reflects the fact that U(A"|M) group contains U(Ai) and U(M) groups 
as its subgroups, and the corresponding characters are labeled by the partitions ji and n 
obtained from the original A. 
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B Refined U(l|l) theory 


In this Appendix we show several explicit results for the simplest situation in the refined 
U(A^|M) theory with N = M = 1. Let us first compute the partition function for the (P, Q) 
torus knot (j4.14D . which includes the original situation (I4.4p as {P,Q) = (1,1), 


2:, 


Ref,(P,Q)_ f 


U(l|l) 


/ dx dy 
2 tt 2tt 


/3-1 


m=0 


( 2 cosh 


X - y - mgs 
2P 


-1 


2 cosh 


X - y - mgs 
2Q 


-1 


(B.l) 


Applying the Fourier transformation formula 


1 


dz 


2 cosh u) / 27r coshz ’ 


(B.2) 


we have an expression, 


27r 27r 27r 27r 

m=0 m=0 


cosh Zm cosh Wr. 


(B.3) 


Integrating out x and y variables first, we obtain 

pn 

,,Ref, (P,Q) _ PQ 


(AQ) = ^ J] ' (^qQm/2 + q-Qm/2 


-1 


m=0 


(B.4) 


By taking (P, Q) = (1,1) and the non-refined limit /3 = 1, it reproduces the known result for 
the non-refined U(l|l) theory. 


„Ref, (P,Q) _^ 

^U(1|1) ^ ^U(1|1) - 4/. ■ 


(B.5) 


Let us then compute the unknot average with {P,Q) = (1,1)- In this case, only the 
hook representation is possible for the U(l|l) Macdonald polynomial as well as the Schur 
polynomial (otherwise it trivially vanishes), and thus the conjectural formula (j4.5l] yields 


/3-1 


M(a|fe)(e^;e^) = [J U^iqm/2 ^ ^yjq-m/2 


m=0 


p-i 


= ^{a+^)x+{b+^)y 2 cosh 


m=0 


x-y - mgs 


(B.6) 


Thus the average of this Macdonald polynomial is given by 


1_ f ^-hix^-y^) Ja+^)x+{b+^)y 


M(,|,)(e";e^)) = 


27r 27r 
/3-1 


e^ 2' 


^ f 

^Ref, (1,1) / 

^U(l|l) 

/ —m/2 _i_ „m/2V 

- TT +Q ' ) 


0-1 


m=0 


( 2 cosh 


X — y — me 


-1 


= g2V— Yl — 


' 0 + q~^(°'Pb+0-m) 


(B.7) 
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This expectation value should give the unknot invariant, especially the Poincare polynomial 
of the corresponding knot homology, and the first factor can be interpreted as the framing 
factor. 

We can similarly compute the {P, Q) torus knot average with respect to the partition 
function (|4.14l) . Now we rewrite the U(l|l) Macdonald polynomial using the g-binomial 
formula, 

i=0 ^ 


^{a+0-e)x+{b+£)y 


(B.8) 


where the g-binomial coefficient is given by 

fP\ (l-g/^)(l-g/3-l)...(l-gW) 

^ (g^+^;g)oo(g^~^+^g)oo 
oo (g;g) oo 


Thus, if we can compute the expectation value of the monomial i)x+{b+i)y respect 

to the torus knot matrix model, we obtain the torus knot average. Now this average is given 
by 


^{a+/3-e)x+{b+e)y\ 

/ (P,Q) 


/3-1 

n 


gPm/2 _j_ g—Pm/2 


q^ 


Qm/2 _j_ g—Qml2 


0 + q-^{a+b+j3-m) g^-{a+b+j3-m) _|_ 2(a+6+/3-m) 

(B.IO) 


Note that the ^-dependence is only found in the framing factor in this expression, and thus 
we obtain the {P,Q) torus knot average of the U(l|l) Macdonald polynomial. 


M(,|fe)(e";e^) 


/3-1 

n 


g 


Prajl _|_ —Pml2 


^Qml2 Qm/2 


(PQ) J;_o qf + g-f q%{a.+b+0-'m) _|_ q-%(a+b+li-m) 


£=0 


We remark that this expression is symmetric under P Q and q -H- q~^ apart from the 
framing factor. Furthermore, from the view point of the Macdonald polynomial, it is natural 
to have a symmetry of g o t, which is not obvious in this formula. It would be convenient 
to rewrite it using infinite product to see such a duality. 
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